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1  Overall  Summary 

Substantial  progress  has  been  made  on  several  problems  involving  parallel  and  distributed 
computing  and  combinatorial  optimization.  This  research  is  reported  in  the  numerous  papers 
that  are  listed  in  Section  3.  In  what  follows,  we  will  provide  a  brief  description  of  the  research 
activities  of  the  staff  that  are  supported  by  the  contract.  The  faculty  supported  in  part  by 
the  contract  include  Baruch  Awerbuch,  Bonnie  Berger,  Michel  Goemans,  Daniel  Kleitman, 
Tom  Leighton  (the  principal  investigator),  and  Shang-Hua  Teng. 
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2  Individual  Research  Summaries 

2.1  Awerbuch 

Research  directions.  The  emphasis  in  Baruch  Awerbuch ’s  work  this  year  has  been  on 
Uncertainty-Tolerant  Computing.  Ability  to  predict  the  future  would  have  been  an  invaluable 
asset  in  many  areas  of  human  activities  (e.g.  investing  in  the  stock  market).  As  it  turns 
out,  computer  systems  and  communication  networks  are  not  much  different  —  ability  to 
predict  the  future  would  have  greatly  simplified  classical  tasks  such  as  caching  (in  storage 
hierarchy)  or  routing  (in  large  networks).  Unfortunately,  in  reality  knowledge  of  the  future 
is  often  unavailable;  this  poses  serious  obstacles  for  efficiently  utilizing  system  resources. 

Large  distributed  systems  pose  yet  another  obstacle  in  that  knowledge  of  the  present  is 
unavailable  as  well,  since  individual  processors  do  not  know  the  global  state  at  the  remote 
locations.  The  main  intellectual  challenge  posed  by  the  distributed  systems  is  that  they 
must  confront  double  uncertainty,  temporal  uncertainty  about  the  inputs  to  the  program, 
and  spatial  uncertainty  about  the  state  of  the  system. 

The  goal  is  design  of  scalable  systems  that  perform  well,  in  spite  of  these  obstacles.  We 
have  developed  some  new  algorithmic  machinery  for  attacking  the  issues  of  uncertainty,  and 
are  currently  working  on  refining  the  theory  as  well  as  adapting  it  for  practical  settings. 
The  main  research  objective  at  the  moment  is  to  experimentally  test  theoretically-justified 
methods,  focusing  on  a  variety  of  systems  and  network  tasks,  such  as: 

•  Distributed  Directory  Service  and  Mobile  Users  Communication. 

•  Distributed  caching  in  multi-processors  and  file  servers. 

•  Route  selection  for  point-to-point  and  multi-cast  circuit- switching. 

•  Packet  routing  in  faulty  networks  with  changing  topology. 

Research  accomplishments  for  the  last  year  included: 

•  Together  with  Mansour,  Awerbuch  has  developed  topology  update  protocols  efficient 
topology  update  protocols  for  unreliable  networks. 

•  Together  with  Berger,  Cowen,  and  Peleg  [14]  Awerbuch  has  developed  fast  deterministic 
distributed  algorithm  for  network  decomposition. 

•  Together  with  Berger,  Cowen,  and  Peleg  [15]  Awerbuch  has  developed  fast  deterministic 
parallel  algorithm  for  network  decomposition. 

•  Together  with  Kutten,  Mansour,  Patt,  and  Varghese  [25],  Awerbuch  developed  time- 
optimal  self-stabilizing  synchronizers.  (Details  in  individual  section  of  Boaz  Patt.) 

•  Together  with  Yair  Bartal  and  Amos  Fiat  [24],  Awerbuch  has  developed  first  optimally 
competitive  distributed  file  replication  algorithm. 

•  Together  with  Bill  Aiello,  Bruce  Maggs,  and  Satish  Kao  [4]  Awerbuch  hac  developed 
first  load  balancing  algorithms  for  networks  with  dynamically  changing  topology. 
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2.2  Berger 

Berger  spent  the  year  on  leave  from  the  Math  Department  as  a  Science  Scholar  at  the 
Radcliffe  Bunting  Institute.  Her  research  is  currently  focused  on  computational  biology, 
and,  in  particular,  protein  structure  prediction. 

Berger  with  Kellog  and  Shor  [34],  in  conjunction  with  Prof.  Jonathan  King  of  the  Biology 
Department,  studied  virus  assembly.  The  study  of  virus  shell  structure  and  assembly  is 
crucial  for  understanding  how  viruses  reproduce  and  how  anti-viral  drugs  might  interfere 
with  assembly  of  virus  shells.  One  of  the  most  notable  aspects  of  virus  shells  is  their  highly 
regular  structure:  they  are  generally  spherical  and  possess  strong  symmetry  properties. 
Almost  all  human  viruses,  and  many  plant  and  animal  viruses,  are  icosahedral.  These 
include  the  rhinovirus,  poliovirus,  and  herpesvirus,  all  of  which  have  rounded  icosahedral 
shells.  These  icosahedral  shells  are  constructed  of  repeated  protein  subunits,  or  coat  proteins, 
which  surround  their  condensed  DNA  or  RNA  genomes.  A  given  shell  usually  consists  of 
hundreds  of  copies  of  one  protein,  but  sometimes  copies  of  two  or  three  different  proteins. 

Many  of  these  viral  shells  are  believed  to  assemble  with  only  limited  aid  from  cellular 
machinery;  they  appear  to  “self-assemble” ,  or  spontaneously  polymerize  and  take  shape, 
in  the  host  cell  environment.  At  first  glance,  the  assembly  of  the  shells  seems  easy  to 
understand,  because  the  structure  is  so  regular.  In  fact,  it  has  been  difficult  to  determine 
the  actual  pathway  through  which  the  subunits  interact  to  form  a  closed  shell  composed  of 
hundreds  of  subunits.  In  icosahedral  viruses  this  has  been  particularly  difficult  to  explain 
because  very  often  the  same  protein  occurs  in  non-symmetric  positions.  This  has  been  an 
unresolved  question  for  some  time. 

Previous  attempts  at  accounting  for  the  formation  of  closed  icosahedral  shells  from  sub¬ 
units  have  focused  on  the  icosahedral  symmetry,  through  the  Caspar  and  Klug  theory  of 
quasi-equivalence.  This  theory  classifies  icosahedral  shells  whose  protein  subunits  all  have 
very  similar  (quasi-equivalent)  neighborhoods  and  form  hexamers  and  pentamers  in  the  virus 
shell.  The  general  belief  was  that  shells  were  formed  by  assembly  of  these  pentamer  and 
hexamer  building  blocks.  However,  recent  experimental  results  suggest  that  this  may  not 
be  true,  and  that  the  emphasis  on  the  final  symmetry  of  the  structure  has  been  a  barrier 
to  understanding  how  these  proteins  assemble  into  such  complex  structures.  We  consider 
what  an  individual  protein  “knows" ,  from  an  information-theoretic  point  of  view.  It  might 
appear  that  each  protein  needs  to  know  something  about  the  global  structure.  In  fact,  if  the 
proteins  assume  different  conformations  during  the  assembly  process  depending  on  their  rel¬ 
ative  positions,  each  protein  has  enough  local  information  to  “know”  where  to  bond.  Thus, 
a  protein  needs  to  know  nothing  about  what  is  going  on  in  the  rest  of  the  structure  in  order 
to  form  icosahedral  shells. 

We  have  shown  that  a  surprisingly  simple  set  of  local  rules  can  explain  the  assembly  of  all 
icosahedral  viruses,  including  one  whose  structure  has  puzzled  researchers.  In  fact,  for  each 
virus  structure  there  is  a  set  of  local  rules  which,  starting  with  a  single  interaction  between 
two  proteins,  will  uniquely  determine  all  the  other  interactions  necessary  to  assemble  the 
entire  structure.  From  a  mathematical  point  of  view,  these  rules  can  be  applied  in  any 
order,  and  the  same  shell  results. 

With  UROP  Muir,  Berger  is  now  simulating  the  assembly  process  computationally,  and 
they  are  designing  the  first  "tool  kit”  that  will  allow  biologists  to  study  virus  assembly  on 
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the  computer  screen.  Berger  and  Muir  have  a  working  demo  simulating  3D  virus  assembly, 
and  she  hopes  next  to  implement  the  program  on  an  SGI  being  purchased  by  Leiserson. 

Berger  is  also  working  with  Prof.  Peter  S.  Kim  of  the  Biology  Department  and  Whitehead 
Institute  on  algorithms  to  predict  3D  protein  structure  from  sequence.  UROP  Tonchev  has 
been  assisting  in  this  project.  Berger  and  Kim  received  a  grant  from  the  Science  Partnership 
Fund  in  the  School  of  Science  for  this  work. 

Berger  continued  developing  algorithms  for  network  decompositions  in  the  sequential, 
distributed,  and  parallel  domains  with  Awerbuch,  Cowen,  and  Peleg  [16].  Portions  of  this 
work  appeared  at  SWAT  in  July  and  PODC  in  August,  and  recent  developments  will  appear 
in  the  upcoming  FOCS. 

2.3  Goemans 

During  the  past  year,  Goemans  has  made  considerable  progress  in  deriving  efficient  approx¬ 
imation  algorithms  for  combinatorial  optimization  problems. 

We  first  would  like  to  give  an  update  on  the  general  primal-dual  approximation  tech¬ 
nique  for  network  design  problems  that  was  mentioned  in  the  last  report.  The  technique  has 
proved  to  be  very  powerful  and  has  led  to  numerous  results  and  publications.  The  original 
paper  [70]  was  accepted  for  publication  in  SIAM  Journal  on  Computing.  The  extension  with 
Williamson,  Mihail  and  Vazirani  [108]  to  problems  with  larger  connectivity  has  appeared  in 
the  proceedings  of  the  25th  STOC.  The  faster  implementation  jointly  obtained  with  Gabow 
and  Williamson  [57]  has  appeared  in  the  proceedings  of  the  3rd  IPCO  conference.  More¬ 
over,  during  the  year,  the  result  has  been  improved  in  several  directions  in  joint  research 
with  Goldberg,  Plotkin,  Shmoys,  Tardos  and  Williamson  [64]  and  will  appear  in  the  pro¬ 
ceedings  of  the  5th  SODA.  One  of  the  improvements  is  that  the  performance  guarantee  has 
been  lowered  from  2k  to  2  In  k  for  the  generalized  Steiner  network  problem,  where  k  is  the 
largest  connectivity  requirement.  As  a  side  remark,  the  generalized  Steiner  network  problem 
arises  in  the  design  of  fiber-optic  networks,  and  Bellcore  is  considering  the  addition  of  the 
approximation  algorithm  to  their  network  design  software  package.  A  computational  study 
of  our  approximation  algorithm  in  the  case  of  the  minimum  weight  matching  problem  was 
performed  with  Williamson  [107]  (to  appear  in  the  5th  SODA).  This  has  shown  that  our  ap¬ 
proximation  algorithm  not  only  has  a  nice  worst-case  behavior  but  also  performs  extremely 
well  in  practice.  In  over  1,400  experiments  on  random  and  real-world  instances  having  be¬ 
tween  1,000  and  131,072  vertices,  the  algorithm  was  never  more  than  4%  from  optimal. 
Finally,  David  Williamson,  our  first  Ph.D.  student,  has  graduated  during  the  summer. 

With  Williamson  [71],  we  have  also  further  simplified  the  |-approximation  algorithm  for 
the  maximum  satisfiability  problem  that  was  described  in  the  previous  report.  The  new 
algorithm  is  extremely  simple  and  illustrates  the  fact  that  the  best  of  two  approximation 
algorithms  can  have  a  performance  guarantee  strictly  better  than  any  one  of  them. 

On  a  different  line  of  research,  we  have  performed  a  theoretical  study  of  the  most  succesful 
computational  approach  for  the  traveling  salesman  problem  [63].  This  lead  to  some  fairly 
surprising  results.  In  particular,  we  have  shown  that  the  most  commonly  used  class  of  cutting 
planes,  the  so-called  clique  tree  inequalities,  can  only  lead  to  a  multiplicative  improvement 
of  |,  while  other  classes  can  lead  to  an  improvement  of 
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Two  other  results  which  we  would  like  to  report  are  [56]  and  [67],  The  first  result  is  a 
result  in  graph  theory,  while  the  second  establishes  the  precise  maximum  time  of  survival  of 
a  system  composed  of  processors,  in  which  processors  can  fail  and  cannot  be  repaired. 

2.4  Kleitman 

During  the  reporting  period,  Professor  Kleitman  has  been  involved  in  the  following  rese  ->.rch 
projects  for  which  papers  have  been  prepared  for  publications: 

Area:  Combinatorial  Geometry 

Subject:  The  Hadwiger  Debrunner  Conjecture 

Co-author:  Noga  Alon 

Summary:  We  were  able  to  prove  this  long  standing  conjecture:  that  if  a  collection  of  N 
closed  convex  sets  in  Euclidean  d-space  have  the  property:  out  of  any  k  sets  there  is  a  point 
in  j  of  them,  with  j  >  d,  then  there  are  f(j,  d,  k)  points  (independent  of  N)  such  that  every 
set  contains  at  least  one  of  them. 


Area:  Combinatorial  Geometry 

Subject:  Maximum  Diameter  of  an  n  sided  simplex  in  d  dimensions 
Co-author:  Gil  Kalai 

Summary:  We  were  able  to  improve  an  argument  of  Kalai  which  gives  a  sub-exponential 
(but  not  polynomial)  bound  for  this  diameter;  Kalai  has  subsequently  used  the  idea  here  to 
develop  a  probabilistic  simplex  algorithm  with  provably  good  properties. 


Area:  Graph  Theory 

Subject:  Graphs  with  independent  sets  of  cardinality  at  most  two 
Co-author:  Wayne  Goddard 

Summary:  We  were  able  to  improve  a  conjecture  of  Harary  that  any  such  graph  on  2n  —  1 
vertices  contain  every  graph  having  n  edges  as  a  subgraph.  (This  was  proved  independently 
by  a  different  method  by  Sidorenko). 


Area:  Graph  Theory 

Subject:  Directed  Graphs  without  even  length  simple  cycles 
Co-authors:  Fan  Chung  and  Wayne  Goddard 

Summary:  We  were  able  to  prove  a  conjecture  of  Brualdi  and  Shader,  giving  the  exact  upper 
bound  to  the  number  of  edges  in  such  a  graph,  and  also  gave  a  partial  characterizations  of 
all  graphs  realizing  this  bound. 


Area:  Extremal  Set  theory 

Subject:  Maximal  sets  of  given  diameter  in  product  of  chains 
Co-author:  Leonard  Schulman 

Summary:  We  were  able  to  show  that  a  certain  ordering  of  the  elements  in  products  of  n 
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even-length  chains  have  the  property  that  initial  segments  in  this  order  will  always  have 
minimum  cross-distance  between  them  given  their  cardinalities.  Cross  distance  between  two 
sets  is  the  maximum  (Manhattan)  distance  between  an  element  of  one  and  one  of  the  other. 
We  also  related  this  question  to  various  others. 


Area:  Extremal  Set  Theory 

Subject:  Finding  arrangements  of  lines  in  the  n-cube 
Co-authors:  Ron  Holzman  and  Alexander  Felzenbaum 

Summary:  We  were  able  to  show  that  given  any  sequence  ( C} )  for  j  =  1  to  n,  of  positive 
integers  summing  to  2„_i,  we  can  find  c,  lines  in  the  J-direction  through  vertices  of  the 
n-cube,  all  of  which  are  disjoining. 


Area:  Combinatorial  Geometry 
Subject:  Epsilon  nets 

Co-authors:  Noga  Alon,  Zoltan  Furedi  and  I.  Barany 

Summary:  An  epsilon-net  for  a  set  Y  in  Rj  is  a  set  S  of  points  of  Y  contains  an  element 
of  5.  We  show  that  in  the  such  sets  exist  having  cardinalities  dependent  only  on  d  and  epsilon. 


Area:  Combinatorial  Geometry 

Subject:  Connecting  pairs  of  points  in  the  plane  with  mutually  intersecting  line  segments 
Co-authors:  B.  Aronov,  P.  Erdos,  M.  Klugerman,  J.  Pach,  and  L.  Schulman 
Summary:  We  were  able  to  show  that  given  n2  points  we  could  find  at  least  n/12  pairs  that 
could  be  connected  by  line  segments  such  that  all  segments  intersect. 


Area:  Graph  Theory 

Subject:  Convergence  of  a  Transformation 
Co-author:  Wayne  Goddard  ,  Dean  Sturtevant 

Summary:  We  obtained  upper  bounds  to  the  speed  of  convergence  of  transformations  on 
weighted  graphs  that  map  the  weight  on  a  vertex  to  an  extreme  value  of  weight  in  its  neigh¬ 
borhood  (including  itself).  Several  problems  of  this  kind  are  considered. 


Area:  Set  Theory 

Subject:  Set  Systems  with  No  Union  of  Cardinality  0  Modulo  m 

Co-authors:  Noga  Alon,  Richard  Lipton,  Roy  Meshulam,  Michael  Rabin  and  Joel  Spencer 
Summary:  We  show  that  in  any  collection  of  sets  each  set  having  at  most  d  elements,  of 
cardinality  at  least  d{q- 1)  +  1,  there  is  a  non  trivial  subcollection  having  union  of  cardinality 
congruent  to  O  mod  q,  for  q  a  prime  power. 
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2.5  Leighton 

In  the  area  of  parallel  computation.  Professor  Leighton  (together  with  Bruce  Maggs  of  NEC 
and  Ramesh  Sitaraman  of  Princeton)  has  developed  the  first  methods  for  tolerating  more 
than  a  small  number  of  worst-case  faults  in  commonly-used  networks  such  as  the  butterfly, 
the  mesh  of  trees,  and  other  hypercubic  networks.  Previously,  work  on  the  fault-tolerance 
properties  of  these  networks  was  limited  to  showing  how  to  overcome  a  single  fault  by  adding 
an  extra  stage  of  hardware  to  the  network.  In  the  new  work,  Leighton  and  his  collaborators 
have  shown  how  to  overcome  large  numbers  of  faults  (i.e.,  jV  9  worst-case  faults)  with  only 
a  small  (i.e.  constant)  loss  in  performance.  This  means  that  the  butterfly  is  much  more 
tolerant  to  faults  than  previously  realized.  Details  of  this  research  were  reported  at  the 
recent  FOCS  conference  in  Pittsburgh. 

Prof.  Leighton  also  completed  work  on  his  text  “Introduction  to  Parallel  Algorithms 
and  Architectures:  Arrays,  Trees,  Hypercubes,”  which  was  published  by  Morgan  Kaufmann 
Publishers.  The  text  has  already  sold  over  5000  copies  and  is  being  used  as  the  basis  for 
courses  on  parallel  algorithms  and  architectures  at  numerous  universities  throughout  the 
world. 

Prof.  Leighton  also  continued  work  in  the  area  of  randomly-wired  networks.  Substantial 
progress  was  made  on  problems  involving  deterministic  routing  on  multibutterflies  with 
multiplicity  two.  Previous  work  on  multibutterflies  only  applied  to  networks  with  multiplicity 
three  or  more.  The  case  of  multiplicity  two  is  of  greater  practical  interest,  however,  and 
Leighton  was  able  to  develop  proof  techniques  that  demonstrate  that  these  networks  also 
posses  many  of  the  important  routing  properties  held  by  networks  with  higher  multiplicity. 

Prof.  Leighton  is  currently  studying  worst-case  routing  problems  in  meshes.  Somewhat 
surprisingly,  he  has  shown  that  if  the  common  oblivious  greedy  algorithm  is  used  for  routing 
in  a  mesh,  and  if  we  have  a  worst-case  routing  problem  such  as  the  bit-reversal  permu¬ 
tation,  then  3-d  meshes  are  actually  substantially  *slower*  than  2-d  meshes!  Also,  Prof. 
Leighton  has  found  examples  where  even  adaptive  routers  can  fail  badly  for  meshes  of  small 
dimensions.  This  work  is  now  being  written  up  for  publication. 

Professor  Leighton  and  Baruch  Awerbuch  developed  improved  algorithms  for  multi- 
commodity  flow.  Multicommodity  flow  is  a  classic  problem  with  applications  to  problems 
such  as  VLSI  routing,  communication  in  networks,  scheduling,  transportation,  and  opera¬ 
tional  logistics.  Profs  Awerbuch  and  Leighton  have  devised  a  wholly  new,  and  very  simple, 
approach  to  the  multicommodity  flow  problems  which  appears  to  work  much  better  than 
previously  known  methods.  The  new  approach  appears  to  be  particularly  useful  for  parallel 
computation  and  for  distributed  environments  where  demands  and  capacities  can  vary  with 
time. 

Prof.  Leighton  and  Y.  Ma  (his  student)  developed  a  new  framework  for  studying  Boolean 
circuits  with  faults.  As  a  consequence,  they  have  discovered  circuits  for  the  classic  sorting 
problem  which  can  be  shown  to  be  optimal  in  the  presence  of  faults.  This  work  has  applica¬ 
tions  in  the  domain  of  circuit  switching  where  messages  are  often  sorted  as  a  preconditioner 
to  routing. 

In  addition  Leighton  and  Ma  discovered, 

1)  a  passive-fault-tolerant  sorting  circuit  with  0(log  n  log  log  n)-depth  and  0(n  log  n  log  log  n)- 
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size,  which  resolves  a  long-standing  open  question  posed  by  Yao  and  Yao  to  within  an 
0(log  log  n)  factor, 

2)  a  reversal-fault-tolerant  sorting  network  with  0(n  log‘°gj  3  n)-size  provided  that  the 
failure  probability  is  upper  bounded  by  a  sufficiently  small  constant,  which  partially 
resolves  an  open  question  posed  by  Assaf  and  Upfal,  and 

3)  a  fault-tolerant  sorting  algorithm  that  runs  in  O(logn)  steps  on  an  0(n)-processor 
EREW  PRAM,  which  resolves  an  open  question  posed  by  Feige,  Peleg,  Raghavan,  and 
Upfal. 

All  the  results  are  based  on  a  new  analysis  of  the  AKS  sorting  circuit,  which  is  of  interest  in 
its  own  right. 

2.6  Teng 

In  the  past  year,  I  have  been  working  in  several  areas  in  theoretical  computer  science  and 
scientific  computing.  The  following  summarizes  some  of  these  works. 

•  “Approximating  shortest  s’  perstrings”. 

•  “Optimal  online  scheduling  of  parallel  jobs  with  dependencies” . 

•  “Automated  parallel  solution  of  unstructured  PDE  problems” . 

We  propose  and  develop  a  practical  scheme  for  solving  large  scale  unstructured  PDE 
problem  in  parallel.  The  core  of  this  scheme  is  the  geometric  mesh  partitioning  algo¬ 
rithm  that  I  have  developed  m  a  joint  work  with  Miller,  Thurston,  and  Vavasis. 

•  “Moment  of  inertia  and  graph  separators” . 

•  “Geometric  mesh  partitioning  and  nested  dissection” . 

•  “Parallel  construction  of  quadtrees  and  quality  triangulations” . 

We  design  the  first  provably  good  parallel  algorithm  for  automatically  generating  well¬ 
shaped  finite  element  meshes. 

•  “How  Good  is  Recursive  Bisection” . 

•  “Approximating  center  points  with  iterated  Radon  points” . 

•  “A  deterministic  linear  time  algorithm  for  geometric  separators  and  its  applications”. 

•  “k-nearest-neighbor  clustering  and  percolation  theory” 

•  “Automatic  array  alignment  in  data-parallel  programs” . 

We  proposed  solutions  to  various  problems  occurred  in  compiling  for  data-parallel  ma¬ 
chines.  Part  of  my  work  was  done  when  I  was  with  Xerox  and  NASA  Ames.  Our  idea 
of  generating  local  address  and  communication  sets  of  data-parallel  programs  have  been 
patented. 
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•  Opportunistic  Optimization  and  Incremental  Divide-and-eonquer  in  Sparse  Matrix 
Computations. 

•  I  have  designed  and  implemented  a  parallel  geometric  mesh  partitioning  program  in 
CM-Fortran.  Thinking  Machine  Corporation  is  planning  to  incorporate  it  into  its 
CMSSL  (of  course  depending  on  some  kind  of  legal  agreements  between  MIT  and 
Thinking  Machine  Corp.  about  the  copyright.) 
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